BD 197 512 



DOCOBENT fiESOME 



EC 131 7n 



TITLE 

TNSTTTOTION 

SPONS AGENCY 

rPPORT NO 
POP DATE 
C0NT5RCT 

NOTE 



ThQTlow, Har*ha L, : Ysseldyke, James E. 
Factors ir.f luer.tial on the PsychoeducatiOEal 
Decisions Beached b7 Teams of ' Educator s. 
Minnesota Dniv* , Minneapolis. Tnst- for Research on 
Learning Disabilities. 

Bnreau of Education for the Handicapped (DHEW/OE> , 

Washington, D«C- 

IBLD-PE-25 

Feb 8 0 

300-77-0U91 

33p-: For related docujoents, see EC 131 7 09-720, 



EOPS PSICE 
DFSCPIPTOPS 



MF01/PC02 Plus Postaae- 

Academic Achievement; "Slementary Education: 
Exceptional Child Research: *Learning Disabilities; 
Physical Characteristics; Sex Differences; 
Socioeconomic Influences: *Studert Characteristics: 
♦Student Placement 



ABSTRACT 

Four groups of edticational decision mekers rated the 
influence of nine pieces of information on the decsions they made 
about the educational placement of a handicapped elementary class 
child. Information regarding the sey, socioeconomic status (SESW and 
physical attract ivene-ss of the student had an insignificant effect on 
decisions. Information on academic scores vas believed to have a 
greater influence, with achievement and intelligence scores having a 
significant effect. Findings are reviewed in light of the recent 
deroonsttation that child characteristics such as sex, SES, and 
attractiveness did influence decisions. (AuthorV 
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Abstract 

Four groups of educational decision makers rated the influence 
of nine pieces of information on the decisions they made about the 
ediicational placement of a child. Information regarding the sex, 
socioecono:nic status, and physical attractiveness of the student were 
seen as having an insignificant effect on decisions. Information 
on academic scores was believed to have a greater influence, with 
achievement and intelligence scores having a significant effect. 
These findings are reviewed in light of the recent demonstration that 
child characteristics such as sex, SES, and attractiveness did in- 
fluence decisions reached by one of the groups included in this study. 
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Factors Influential on the Psychoeducational Decisions 
y Reached by Teams of Educators 

Public Law 94-142 requires that teams of educators and other rele- 
vant individuals reach consensus as a group on a child's eligibility for 
special services, the appropriate placement of that child, and the speci- 
fic individual education plan (lEP) to meet the child's needs. Surveys 
of current assessment and decision-^making practices (Poland, Ysseldyke, 
Thurlow, & Mirkin, 1979; Thurlow & Ysseldyke, 1979) indicate that the 
teams involved in making such decisions are multidisciplinary in composi- 
tion, usually including an average of seven different members. 

When attempting to reach an appropriate decision for a particular 
student, educational decision makers are exposed to a massive amount 
of data upon which the decision supposedly is to be based. In addition 
to test data, decision makers are aware of other characteristics of the 
child, such as sex, socioeconomic status, and physical appearance. Sur- 
veys of placement team meatings conducted in elementary schools during 
1978-79 suggested that much of the time in a typical meeting was devoted 
. to the presentation of results of the child's performance on a variety 
of tests (Allen, Note 1). Very often, the data presented are derived 
from devices with inadequate technical adequacy (Thurlow & Ysseldyke, 
1979; Ysseldyke, Algozzine, Regan, 5e Potter, 1979). 

Numerous researchers have addressed the issues of the effect of 
child characteristics on educators. Such characteristics have biased 
decisions throughout the decision-making process (Ysseldyke, 1978) • 
Ross and Salvia (1975) demonstrated triat a child's facial appearance 
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influenced placement decisions made for the child. A child's social 
class may affect the nature of interactions between the child and assessor 
and the assessor's behavior toward the child (Ysseldyke & Algozzine, 1979;; 
evidence indicates that the assessor's behavior during an evaluation may 
influence the outcome of that evaluation (Masling, 1957). Others have 
demonstrated that a child's sex influences the interpretations of the 
behaviors demonstrated by the child (Adams & LaVoie, 1974; Schlosser & 
Algozzine, 1979)- 

Large amounts of information are provided to teams of decision makers. 
They must sort through the data and judge the importance of the various 
pieces of information for the decisions to be made. The determination of 
what information is most relevant is especially pertinent in the area of 
learning disabilities, where there has been difficulty even in reaching 
consensus as to the definition of a learning disability (Mercer, Forgnone, 
& Wolking, 1976;. Thurlow & Ysseldyke, 1979). Ysseldyke and Algozzine (1979) 
propose that LD remains a category of underachievement , despite '^numerous 
attempts to create a more sophisticated disability*^ (p. 4). Commonly used 
criteria for identifying a learning disability have been critized (Algozzine 
& Sutherland, 1977). Yet, team decision making is mandated. Teams must 
review the data available to them and make their decisions. Teams in 
schools across the nation are making decisions about the placement of LD 
children based on the information available to them. 

The purpose of the present research was to characterize the influence 
of several types of information typically available to members of such 
school-based decision-making teams. A special sampling methodology was 
employed to provide a broad data base, and. to address issues related to 
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different methodologies that might be used to ascertain the influence 
of the various types of information* 

Method 

Design 

Four different methodologies were used to gather data on the 
extent to which different types of data influenced or were perceived 
as influencing the decision-making process. 

A computer simulation of the decision-making process was used in 
the first investigation. Decision makers received basic data 
on the characteristics of referred students, engaged in simulated 
assessment by accessing data of their choice from the computer archives, 
and then made a series of decisions about the referred student. 
Following completion of the decision making, subjects were asked to state 
the extent to which specific test scores and information and specific 
student characteristics had influenced their decisions. 

The second investigation used a ques':ionnaire methodology in which 
a national sample of directors ot special education was asked to indicate, 
on the basis of their experience in participating in team decision-making 
meetings, the extent to which specific kinds of assessment information 
and spec.-lfic student characteristics influenced outcome decisions. 

In the third study^ data were collected from placement team meeting 
participants immediately following a team meeting. Again, participants 
were asked to indicate the extent to which specific kinds of assessment 
infonnation and specific student characteristics had influenced the 
decisions that were made. 
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Study 4 used a self-raport methodology in which a group of 
decision makers were asked, on the basis of their experience, to 
report the extent to which specific kinds of test information and 
specific student characteristics influenced outcome decisions, 

i 

In all four studies, the same question was asked. The item is 
listed in Appendix A. Subjects in Study 1 responded to the question 
on a Telray computer terminal, while those in studies 2 through 4 re- 
sponded in a paper and pencil format. 

Subjects 

A total of 536 individuals participated in the four studies. All 
individuals had been participants previously in team decision-^making 
meetings. 

In Study 1, 224 educational personnel completed a simulated decision- 
making exercise. All were volunteers from the greater Minneapolis/3 t . 
Paul metropolitan area, and all had served previously on at least two 
placement teams. Occupational groups represented in the sample included 
administrators, regular education teachers, special education teachers, 
school psychologists, and support personnel (e.g., nurses, counselors, 
social workers, etc.). Demographic data on the 224 participants are 
reported in Appendix B. 

Subjects for Study 2 were 89 directors of special education from 
49 states. They represented schoo? districts of varying size (100 to 
50,000 elementary pupils), type of community (urban, suburban, rural), 
and special education budget ($372.00/student to $7591.00/student) . 
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A total of 159 members of placement teams in Minnesota and North 
Dakota comprised the sample for Study 3. These individuals responded 
to questions on the influence of scores and pupil characteristics 
ixnmediately following completion of a team meeting. 

Subjects for Study 4 were 64 practicing school psychologists or 
educational diagnosticians from Virginia. 

Procedures 

Subjects completed the influence item at various times throughout 
the 1978--79 academic year. Computer simulation subjects completed the 
item after reaching eligibility and placement decisions about a child. 
The child's characteristics were presented to the subjects in a case 
file report. The child's test scores were accessed by the subject via 
the computer terminal. The subject was allowed to select the specific 
devices from which information was desired as well as the amount of 
information provided (e.g., scores only; description of test: quali- 
tative information about test performance). The influence item was 
^ one of nine items in nhe final portion of the computer simulation 

program. 

Special education directors completed the influence itam as part 
of a questionnaire on the decision-making piocedures in cheir school 
districts. Other items in the questionnaire asked the directors to 
provide demographic information about their school districts, specify 
the individuals involved in making several types of educational decisions, 
describe the typical sequence of decision-making activities, and list 
the major problems encountered in the decision-making/IEP development 
process. 

ERIC 
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Placement team members completed the influence item after parti- 
cipating in an actual placement meeting. In some cases, the subjects' 
participation in the meeting had been videotaped by researchers. In 
other cases, subjects completed tha item after videotaping the meeting 
themselves, without researchers present. 

The subjects for Study 4 completed the influence item before lis- 
tening to a presentation on current issues in assessment and decision 
making. They vere instructed to complete the item by considering the 
factors' influence in typical meetings they attended. 

Resul ts 

Because of the large .sample sizes, which are conducive to the 
finding of significant differences for relatively small differences in 
ratings, an additional criterion was applied following standard statis- 
tical tests to separate cut trivial differences. Only mean differences 
of 0.5 or greater on the rating scale were considered as important. 
Such a difference represented a 10 percent unit difference on the five- 
point rating scale. 

The overall ratings of the influence of child characteristics and 
test scores by che four groups of subjects are presented in Table 1. 

Insert Table 1 about here 

A repeated measures ANOVA on these data indicated that there were sig- 
nificant differences between the ratings of the subject groups, F (3,520) 

21.80, £ < .001, between the tv:o types of information F (1,520) = 
2116.75, 2^ < .001, and a significant interaction between the subject 
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groups and types of information, £ (3,520) = 11.30, £ < -001. Clearly, 
academic scores, with a mean rating of 2.44, were seen as having much 
greater influence on the decision than child characteristics, with a 
mean rating of 4.16. The significant group effect was tested by means 
of Studeiit-Newman-Keuls post hoc analysis. Overall, the f Victors had 
significantly greater influence in the Virginia sample than they did in 
the other subject groups (p's < .05); they had significantly less influ- 
ence for the team members (p's < .05). There was no statistically signi- 
ficant difference between the overall ratings of special education directors 
and simulation subjects. Only the difference between the Virginia sample 
and the team members exceeded the 0.5 criterion for a meaningful difference. 

Figure 1 portrays the significant interaction effect. The relations- 
ships between ratings of ch^.ld characteristics and academic scores were 
essentially parallel tor the special education directors, team members, 
and Virginia sample; .:or simulation subjects there was a smaller differ- 
ence between the rati^igs given to the two types of information. 

Insert Figure 1 cxbout here 

The ratings of the influence of different types of child charac- 
teristics by the four subject groups are presented in Table 2. Overall ^ 
the ratings suggested the effect of child characteristics was insignifi- 
cant. A repeated measures ANOVA indicated that there were significant 
differences between the ratings of the subject groups, £ (3,520) = 22.00, 
p < .001, and between the child characteristic ratings, (2,1040) = 40.29, 
P < .O&l. Student-Nevnnan-Keuls post hoc analyses indicated the same dif- 
ference in child characteristic ratings as indicated in overall ratings: 
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the Virginia sample indicated a significantly greater effect (£ < .05), 
team members a significantly lower effect (£ < .05), and special educa- 
tion directors* and simulation subjects' ratings essentially were the 
same. The important differences (i.e., > 0.5) were between the Virginia 
sample and both the special education directors and the team members. 
Related _t test post hoc analyses indicated that: (a) SES was seen 
as having a greater influence on the decision than sex or attractive- 
ness Csl s -< .001), and (b) attractiveness was seen as having a greater 
influence on the decision than sex (p^ < .001). None of these differences 
reached the established criterion for significance. 

Insert Table 2 about here 

The ratings of the influence of different types of academic 
scores by the four subject groups are presented in Table 3. A repea!;:ed 
measures ANOVA on these data indicated that there were significant 
differences between the ratings of the subject groups, (3,520) - ' 
12.62, £ < .001, between the test score ratings, F (5,2600) = 34.32, 
£ < *001, and a significant interaction between the subject groups 
and test scores, 7^ (15,2600) = 7-93, £ < .001, Student-Newman-Keuls 
post hoc analysis of the subject group effect indicated that team 
members and simulation subjects f:uve similar ratings and the Virginia 
sample and special education directors also gave similar ratings. 
The ratings of team members and simulation subjects were significantly 
higher than those of the Virginia sample and special education directors. 
None of the group differences met the 0.5 criterion for significance. 
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Related _t ce«^ post hoc analyses indicated that all comparisons among 
types of scores were significant except that between perceptual -motor 
test scores and adaptive behavior test scores • In terms of practical 
significance, however, IQ and achievement were not different • Both 
had a practically significant greater influence than language, adaptive 
behavior, and perceptual-motor scores. In addition, achievement scores 
were rated as having a greater influence than behavioral recordings. 
The difference between 10 scores and behavioral recordings was con- 
sidered to be trivial. 

Insert Table 3 about here 

Figure 2 portrays the significant interaction effect. The rela- 
tionships among the ratings of different academic scores were essen- 
tially the same for simulation subjects and placement team members 
and for special education directors and the Virginia sample. The 
latter two groups exhibited nearly flat curves while the simulation 
subjects and placement team members exhibited curves more consistent 
with the overall differences found between the six types of academic 
test scores. 



Insert Figure 2 about here 



Discussion 

Individuals involved in making decisions about students are 
e::rosed tc a variety of information. Some of the inforxatiion is collected 
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specifically to help in the decision-making process • Other information 
13 available to decision makers, even when it is supposedly not to be 
a factor in the decision • Persons involved in making placement decisions 
appear to have clear notions as to the effects of various types of in- 
formation in the decisions they reach. 

The decision makers in the present investigation believed that aca- 
demic scores had a much greater influence on their decisions than did 
child characteristics • When considering child characteristics, SES was 
seen as having the greatest influence; yet this difference did not reach 
the established criterion for practical significance • In addition^ the 
SES factor was still rated as having an insignificant effect • I^en con- 
sidering academic scores, achievement and intelligence scores were rated 
as having the greatest influence. Both types of scores received overall 
average ratings indicating a significant effect, a finding which suggests 
that underachievement does play an important role in decisions (cf, 
Ysseldyke & Algozzine, 1979). 

I^fhile all participants in the present analysis were individuals in- 
volved in decision-making processes, the degree to which they were in- 
volved before rating the various factors varied greatly* The Virginia 
sample axic^ the special education directors had not been involved in 
making an actual decision before rating the influence of the factors. 
Computer simulation subjects had just made a decision about a student, 
but under contrived conditions and for a hypothetical child. Placement 
team members had bean involved in making a real team decision about an 
actual child about whom they probably knew something more than what had 
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been presented to them. 

In light of these differences in the subject groups, it is inter- 
esting that relatively few differences of practical significance were 
observed. These differences emerged in the overall mean ratings and in 
the mean ratings of child characteristics. In both cases, the Virginia 
sample gave lower ratings than the team members. For child characteristics, 
the Virginia sample ratings also were lower than those of the special edu- 
cation directors. No differences of practical significance emerged among 
the groups for ratings of academic scores. These results point to the 
validity of the computer simulation approach to studying decision making, 
and also to the representativeness of the ratings of one group of adminis- 
trators (special education directors) when using all placement team mem- 
bers as the criterion sample. 

The similarity of the computer simulation subjects' ratings and those 
of the other groups, however, leads to questions regarding the actual in- 
fluence of the factors in decisions. All groups indicated that the influ- 
ence of child characteristics on decisions was minimal* Yet, analysis of 
the influence of such characteristics on placement and prognostic decisions 
by computer simulation subjects revealed that information on a child's sex, 
SES, physical appearance, and referral problem did influence the decisions 
reached (Algozzine & Ysseldyke, 1979; Ysseldyke, Algozzine, Regan, & 
McGue, 1979). Others (Adams & Cohen; Finn, 1972; Kehle, 1974) have sug- 
gested that while a particular child characteristic may not demonstrate 
a statistically significant main effect, complex interactions of child 
characteristics and other information bias perceptions and expectations. 

Such findings imply that decision makers may not realize that many 
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factors, other than those they are discussing, do influence their 
decisions. Perhaps the recognition that child characteristics do in- 
fluence decisions in many cases would help decision makers deal objectively 
with the possible biases these factors may be introducing into their deci- 
sions. The effectiveness of training courses and programs for decision 
makers, similar to those proposed by Braun (1976) for teachers, should be 
invesci gated. 



o 
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Allen, D. Personal communication, December 1979, 
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Table 1 

Ratings of Significance of Effect of Child Characteristics 
and Academic Scores on Decisions by Four Groups 





Group 


Child 
Characteristics 


Academic 
Scores 


Average 



Simulation Subjects 


4.07 


(0.75) 


2. 


54 


(0.59) 


3, 


.30 


(0. 


.55) 


Special Ed. Directors 


4.20 


(O.&D) 


2. 


25 


(0.44) 


3, 


.23 


(0. 


.38) 


Team Members 


4.48 


(0.57) 


2. 


.56 


(0.72) 


3. 


,52 


(0, 


.53) 


Virginia Sample 


3.70 


(0.78) 


2. 


14 


(0.50) 


2 


.92 


(0, 


.45) 


Combined 


4.16 


(0.68) 


2. 


44 


(0.59) 











Entries are means and standard deviations of subjects' mean ratings, 
where 1 = very significant effect, 2 = significant effect, 3 = moderate 
effect, 4 = insignificant effect, 5 = no effect. 



18 



Table 2 

Ratings of Significance of Effect of Specific Child 
Characteristics on Decisions by Four Groups^ 



Group SES Attractiveness Sex Average 



Simulation Subjects 


3. 


89 


(1. 


07) 


4. 


06 


(1. 


05) 


4. 


25 


(0. 


98) 


4. 


,07 


(1. 


03) 


Special Ed. Directors 


3. 


.92 


(0. 


91) 


4, 


.19 


(0. 


82) 


4, 


.50 


CO. 


71) 


4, 


.20 


(0. 


,81) 


Team Members 


4. 


,36 


(0. 


96) 


4. 


.44 


(0. 


90) 


4, 


.64 


(0. 


,65) 


4, 


.48 


(0. 


,84) 


Virginia Sample 


3. 


,30 


(1. 


09) 


3. 


,72 


(0. 


93) 


4. 


,08 


(1. 


07) 


3. 


,70 


(1. 


03) 


Combined 


3. 


,96 


(1. 


01) 


4. 


,15 


(n. 


95)- 


4. 


,38 


(0. 


85) 











^ Entries are rating mean.i and standard deviations, where 1 = very significant 
effect, 2 = significant effect, 3 = moderate effect, 4 = insignificant effect. 



5 = no effect, 



^3 
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Table 3 

Ratings of Slgnificace of Effect of Various Types of 
Academic Scores by Four Croups 



Perceptual Adaptive Behavioral 
^'foup IQ Achievement Language, Motor Behavior Recordings Average 



Siraulal ion Subjects 


2.08 


(0.87) 


1.79 


(0.82) 


3.09 


(1.25) 


2.82 


(1.28) 


2.98 


(1.40) 


2.45 


(1.18) 


2.54 


(1.13) 


Special Ed, Directors 


2.17 


(0.83) 


2.07 


(0.78) 


2.37 


(0.83) 


2.19 


(0.81) 


2.36 


(0.68) 


2.34 


(0.72) 


2.Z5 


(0.78) 


Team Members 


2.35 


(1.25) 


1.98 


(1.04) 


2.90 


(1.37) 


3.18 


(1.46) 


2.51 


(1.15) 


2.45 


(1.15) 


2.56 


(1.24) 


Virginia Sample 


1.84 


(0.72) 


1.98 


(0.72) 


2.45 


(0.99) 


2.11 


(0.80) 


2.12 


(fl.86) 


2.30 


(0.81) 


2.13 


(0.82) 


Combined 


2.14 


(0.89) 


1.91 


(0.86) 


2.84 


(1.19) 


2.73 


(1.19) 


2.64 


(1.14) 


2.41 


(1.05) 







Entries are rating means and standard deviations, where 1 = very significant effect, 2 = significant effect, 
3 = moderate effect, 4 = insignificant effect, and 5 = no effect. 




ERIC 



20 



Very 
significant - 
effect 



Significant 
effect 



Moderate 
effect 



Insignificant 
effect 



— • Simulation Subjects 

• Special Ed. Directors 

— ^ ■ ^ < Team Members 
• Virginia Sample 




No effect 



I 

Child 
Characteristics 



i 

Academic 
Scores 



Figure 1 . Interaction effect between subject group and type of 
information. 
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Very 
significant 
effect 



Significant 
effect 



Moderate 
effect 



— * Simulation Subjects 
—•Special Ed. Directors 
— • Team Members 
— Virginia Sample 




Insignificant 
effect 



No effect 1 r 1 1 1 1 

IQ Achievement Language Perceptual Adaptive Behavioral 

Motor Behavior Recordings 



Figure 2. Interaction effect between subject group and type of academic score. 
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Appendix A 
Basic Wording of Influence Item 



Please rate the extent to which each of the factors listed below affected 
your decisions. Use the following numbers to indicate the effect of each 
factor. 

1 None 2 = Insignificant 3 ^ Moderate 4 = Significant 5 = Very 

Significant 

Scores on intellectual measures 

Scores on measures of academic achievement 

Child's sex 

Child's socioeconomic status 

Scores on perceptual-motor tests 

Adaptive behavior 

Behavioral recordings 

Child's physical appearance 

Scores on language tests 



Appendix B 

Demographic Data on Computer Simulation Participants 



Sex: 



Male - 57 



Female - 167 



Age ; 



38.4 yrs 



(Range: 23-65 yrs) 



School District Community : Urban - 15 Suburban - 184 Rural - 20 
Regular Class Teaching Experience : X = 6.4 yrs (Range: 0-32 yrs) 
Exceptional Children Teaching Experience : X = 3.7 yrs (Range: 0-28 yrs) 
Non-teaching Support Service Experience : X = 3.2 yrs (Range: 0-23 yrs) 
Number Special Education Courses Taken : X = 8.0 (Range: 0-25) 
Number Statistics Courses Taken ; X = 1.3 (Range: 0-8) 
Niimber Assessment /Measurement Courses Taken : X = 2.3 (Range: 0-12) 
Highest Earned Degree : BA - 107 MA - 96 PhD - 12 

Number Graduate Courses Taken Since Last Degree: X = 9.8 (Range: 0-40) 
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